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METHODS, SYSTEMS, AND COMPUTER PROGRAM PRODUCTS FOR 
REPRESENTING OBJECT RELATIONSHIPS EST A 
MULTIDIMENSIONAL SPACE 

BACKGROUND OF THE INVENTION 

Field of flie laveation 

[0001] The present invention relates generally to data analysis and, more 

particularly, to methods, systems, and computer program products for 
representing object relationships in a multidimensional space. 

Related Art 

[0002] Extracting the minimum number of independent variables that can 

flilly describe a set of experimental observations is a problem of central 
importance in science. Most physical processes produce highly correlated 
inputs, leading to observations that lie on or close to a smooth low- 
dimensional manifold. 

[0003] Since the dimensionahty and nonlinear geometry of that manifold is 

often embodied in the similarities between the data points, a common 
approach is to embed the data in a low-dimensional space that best preserves 
these similarities, in the hope that the intrinsic structure of the system will be 
reflected in the resulting map. See Borg, L & Groenen, P. J. F., "Modem 
Multidimensional Scaling: Theory and Applications," (Springer, New York, 
1997), incorporated herem by reference in its entirety. However, conventional 
similarity measures such as the Euclidean distance tend to underestimate the 
proximity of points on a' nonlinear manifold, and lead to erroneous 
embeddings. 

[0004] To remedy this problem, a well known method Icnown as ISOMAP, 

discussed in Tenenbaum, J., B., de Silva, V., and Langford, J., C, "A Global 
Geometric Framework for Nonlinear Dimensionality Reduction," Science 290, 
2319-2323 (2000), incorporated herein by reference in its entirety, substitutes 
an estimated geodesic distance for the conventional Euclidean distance, and 
uses classical multidimensional scaling (MDS) to find the optimum low- 
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dimensional configuration. Although it has been shown that, in the limit of 
infinite training samples, ISOMAP recovers the trae dimensionahty and 
geometric structure of the data if it belongs to a certain class of EucUdean 
manifolds, the proof is of little practical use since the at least quadratic 
complexity of the embedding procedure precludes its use with large data sets. 
[0005] A similar scaling problem plagues locally linear embedding (LLE), a 

related ^proach that produces globally ordered maps by constructing locally 
linear relationships between the data points. LLE is discussed in Roweis and 
Saul, •'Nonlinear Dimensionality Reduction by Locally Linear Embedding," 
Science 290, 2323-2326 (2000), incorporated herein by reference in its 
entirety. 

[0006] What is needed is an improved method, system, and computer program 

product for extracting the minimimi number of independent variables that can 
fiilly describe a data set. More specifically, what is needed is an improved 
method, system, and computer program product for mapping a set of objects 
related to each other by a set of relationships into a multidimensional space in 
a way that preserves the intrinsic structure of these relationships. 

SUMMARY OF THE INVENTION 

[0007] The present invention is directed to a self-organizing method for 

embedding a set of related observations into an n dimensional space that 
preserves the intrinsic dimensionality and metric structure of tiie data. The 
invention is referred to herein as stochastic proximity embedding (SPE). The 
embedding is carried out using an iterative (e.g., pairwise) refinement strategy 
that attempts to preserve local geometry while maintaining a minimum 
separation between distant objects. In effect, the invention views the 
proximities between remote objects as lower bounds of their true geodesic 
distances, and uses them as a means to impose global structure. 

[0008] The method includes: 
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(1) Specifying a set of bounds for one or more associated 

relationships; 

(2) assigning initial coordinates to the objects on an n dimensional 

map; 

(3) selecting a pair of objects; 

(4) computing a distance d between said selected objects on the n 

dimensional map; 

(5) comparing said distance d between said selected objects on the 

n dimensional map to the bounds of their associated 
relationship r; 

(6) adjusting the coordinates of said selected objects on the n 

dimensional map so that said distance d of said selected 
objects on ttie n dimensional map falls closer within 
said bovmds of said corresponding relationship r, if said 
distance d between said selected objects on the n 
dimensional map falls outside said bounds of said 
corresponding relationship r; 

(7) repeating st^s (3) through (6) for additional pairs of objects; 

and 

(8) outputting the coordinates of one or more objects on the map. 

[0009] Additional features and advantages of the invention will be set forth m 

the description that follows. Yet further features and advantages will be 
apparent to a person skilled in the art based on the description set forth herem 
or may be learned by practice of the invention. The advantages of the 
invention will be realized and attained by the structure particularly pointed out 
in the written description and claims hereof as well as the appended drawmgs. 

[0010] It is to be understood that both the foregoing summary and the 

following detailed description are exemplary and explanatory and are intended 
to provide further explanation of the invention as claimed. 
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BRIEF DESCRIPTION OF THE DRAWINGS/FIGURES 

[0011] The present invention will be described with reference to the 

accompanying drawings, wherein like reference numbers indicate identical or 
functionally similar elements. Also, the leftmost digit(s) of the reference 
numbers identify the drawings in which the associated elements are first 
introduced. 

[00121 FIG. 1 A illustrates a Swiss roll data set in 3-dimensional space. 

[0013] FIG. IB illustrates a 2-dimensional embedding of the Swiss roll data 

set obtained bySPE. 

[0014] FIG. IC iUxistrates the final stress of embeddings of the Swiss roll data 

set obtained by SPE and MDS as a function of embedding dimensionality. 
[0015] FIG. ID illustrates the final stress of 2-dimensional embeddings of the 

Swiss roll data set obtained by SPE as a function of simulation length for four 

data sets containing 10^ 10"^, 10^ and 10^ points. 
[0016] FIG. 2A illustrates a 2-dimensional stochastic proximity embedding of 

1,000 conformations of methylpropylether, C1C2C3O4C5, generated by a 

distance geometry algoritibm and compared by RMSD. 
[0017] FIG. 2B illustrates the final stress of embeddings of 1,000 

methylpropylether conformations obtained by SPE and MDS as a function of 

embedding dimensionality. 
[0018] FIG. 3A illustrates a 2-dimensional embedding of the diamine 

combinatorial library obtained by SPE. 
[0019] FIG. 3B illustrates the final stress of embeddings of the diamine 

combinatorial library obtained by SPE and MDS as a function of embedding 

dimensionality. 

[0020] FIG. 3C illustrates the final stress of 2-dimensional embeddings of the 

diamine combinatorial Ubrary obtained by SPE as a function of simulation 
length for four data sets containing 10^ 10^ 10^ and 10^ compounds. 

[0021] FIG. 4 is a process flowchart 400 for implementing the SPE method. 
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[0022] FIG. 5 is a block diagram of an example computer system on which the 

present invention can be implemented. 

DETAILED DESCRIPTION OF THE INVENTION 
Introduction 

[0023] Modem science confronts us with massive amounts of data, such as 

expression proffles of thousands of human genes, multimedia documents, 
subjective judgements on consumer products or poUtical candidates, trade 
indices, global climate patterns, etc. These data are often highly structured, but 
that structure is hidden in a complex set of relationships or high-dimensional 
abstractions. 

[00241 The present invention is directed to a self-organizing method for 

embedding a set of related observations into a low-dimensional space that 
preserves the intrinsic dimensionality and metric structure of the data. The 
invention is referred to herein as stochastic proximity embedding (SPE). The 
embedding is carried out using an iterative (e.g., pairwise) refinement strategy 
that attempts to preserve local geometry while maintaining a minimum 
separation between distant objects. In effect, the method views the proximities 
between remote objects as lower bounds of their true geodesic distances, and 
uses them as a means to impose global structure. 

[0025] Unlike previous approaches, the present invention reveals the 

underlying geometry of the manifold without intensive nearest neighbour or 
shortest-path computations, and can reproduce the true geodesic distances of 
the data points in the low-dimensional embedding without requiring that these 
distances be estimated from the data sample. The invention scales linearly 
with the number of points, and can be appUed to very large data sets that are 
intractable by conventional embedding procedures. 

[0026] The SPE algorithm utilizes the fact that the geodesic distance is always 

greater than or equal to the input proximity. Similar to ISOMAP, described 
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above, the present invention assumes that the input proximity provides a 
reasonable approximation of the true geodesic distance when the points are 
relatively close, which is generally true if the local curvature of the manifold is 
not too large. Unlike ISOMAP, however, the present invention circumvents 
the calculation of approximate geodesic distances between remote points, and 
only requires that their distances on the low-dimensional m^ do not fall 
below their respective proximities. 

Stochastic TrmdmUy Embedding (SPE) 

[0027] The embedding is carried out by minimizing an error function such as 

the following stress function: 

i<j i<j 
where: 

rff is the input proximity between the z-th andy-th points; 
dff is tiieir Euclidean distance in the low-dimensional space; 
re is the neighbourhood radius; and 
f(dij,ry) is the pairwise stress function defined as: 

fidij,ry) = idy - Tijf if rff ^ or nj > Vc and dy < ry. and 
fidij , ry ) = 0 if nj > n and dy >: ry. 
[0028] The stress function is minimized using a self-organizing algorithm that 

attempts to bring each individual term fidy^ry) rapidly to zero. The method 
starts with an initial configuration and iteratively refines it by repeatedly 
selecting two points at random, and adjusting their coordinates in a way that 
reduces tiheir pairwise stiess fidy ,ry). 
[0029] The correction is proportional to the disparity: 



wo 03/107120 



PCT/US03/18218 



-7- 

where X is a learning rate parameter that decreases during the course of the 
refinement in order to avoid oscillatory behaviour. If Vy > Vc and dij > nj, i.e., if 
the points are non-local and their distance on the map is already greater than 
their proximity r^/, their coordinates remain unchanged. 

[0030] In a preferred embodiment, the intrinsic dimensionality of the manifold 

is revealed by embedding the data in spaces of decreasing dimensions, and 
identifymg the point at which the stress effectively vanishes. 

[00311 When apphed to the Swiss roll, SPE reliably uncovered tiie trae 

dimensionality of 2. As discussed below with reference to FIGS. 1 A through 
ID, the distances of the points on the 2-dimensional map matched the true, 
analytically derived geodesic distances with a correlation coefficient of 
0.9999, indicating a virtually perfect embedding. 

[0032] FIGS. lA through ID illustrate a stochastic proximity embedding of 

the Swiss roll data set. FIG. lA illustrates original data in S-dimensional 
space. FIG. IB illustrates 2-dimeiisional embedding obtained by SPE. FIG. IC 
illustrates a final stress obtained by SPE (mean and standard deviation over 30 
independent runs - the latter is too small and therefore barely visible) and 
MDS as a fimction of embedding dimensionality. FIG. ID illustrates a final 
stress of 2-dimensional embeddings obtained by SPE (mean and standard 
deviation over 30 independent runs) as a fimction of simulation length for four 
data sets containing 10^ 10^ 10^ and 10^ points. FIG. IC, along with FIG. 3D, 
discussed below, demonstrates the linear scaling of SPE - a 10-fold increase 
in sample size results in an approximately 10-fold increase in the number of 
refinement steps that are required to achieve a comparable stress. 

[0033] Similarly, the method was able to detect the intrinsic 2-dimensional 

structure of an ensemble of conformations of methylpropylether compared 
using the root mean square deviation (RMSD). The coordinate axes on the 
resulting map correlate very strongly with the molecule's true conformational 
degrees of fireedom, revealing regions of conformational space that are 
inaccessible due to steric hindrance. 
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[0034] For example, FIGS. 2 A and 2B illustrate stochastic proximity 

embedding of 1,000 conformations of methylpropylether, C1C2C3O4C5, 
generated by a distance geometry algorithm and compared by RMSD. FIG. 2A 
illustrates 2~dimensional embedding obtained by SPE. Representative 
conformations are shown next to highlighted points in different parts of the 
map, along with the corresponding torsional angles, ^C2C^O^Cs 
9C1C2C3O4 » ^ parentheses. The horizontal and vertical directions represent 

rotation around the C3-O4 and C2-C3 bonds, respectively. The unoccupied 
upper-left and bottom-right comers represent conformations that are 
inaccessible because of the steric hindrance between the two terminal carbon 
atoms Ci and C5. FIG. 2B illustrates final stress obtained by SPE (mean and 
standard deviation over 30 independent runs) and MDS as a function of 
embedding dimensionality. 
[0035] SPE can also produce meaningful low-dimensional representations of 

more complex data sets that do not have a clear manifold geometry. The 
embedding of the combinatorial library illustrated in FIGS. 3A througji 3C 
shows that the method is able to preserve local neighbourhoods of closely 
related compounds, while maintaining a chemically meaningful global 
stmcture. 

[0036] For example, FIGS. 3A through 3C illustrate stochastic proximity 

embedding of a diamine combinatorial library. FIG. 3A illustrates 2- 
dimensional embedding obtained by SPE, FIG. 3B illustrates final stress 
obtained by SPE (mean and standard deviation over 30 independent runs) and 
MDS as a function of embedding dimensionaUty. FIG. 3C illustrates final 
stress of 2-dimensional embeddings obtained by SPE (mean and standard 
deviation over 30 independent runs) as a function of simulation length for four 
data sets containing 10^, 10^ 10^ and 10^ compounds. 

[0037] Although the intrinsic dimensionality of this data set is substantially 

higher than 2, the 2-dimejtisional map exhibits global order and continuity, as 
manifested by the dominant role of molecular weight, and the presence of 
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variation patterns that correspond to chemically distinguishing features such as 
chain length, ring structure, and halogen content. See Agrafiotis, D. K., 
Lobanov, V. S., and Salenune, F. R., "Combinatorial Informatics in the Post- 
Genomics Era," Nature Reviews Drug Discovery 1, 337-346 (2002), 
incorporated herein by reference in its entirety. 

[0038] Although SPE does not necessarily offer the global optimaUty 

guarantees of ISOMAP or LLE, it works very well in practice. For example, as 
illustrated by the variances in FIG. IC and FIG. 2B, the method converges 
reliably to the global minimum when the data is embedded in a space of the 
intrinsic dimensionality (and to a low-stress configuration in fewer 
dimensions), regardless of the starting configuration and mitialization 
conditions. More importantly, when applied to data sets of increasing size 
drawn firom the same probability distribution (and therefore expected to have 
comparable stress), the number of sampliag steps required to reach a particular 
stress increases in linear fashion (FIG. ID and FIG. 3C). The memory 
requirements of the method grow linearly as well, since the proximities can be 
computed on demand and need not be explicitly stored. 

[0039] These characteristics are attributed to the stochastic nature of the 

refinement scheme and the vast redundancy of the distance matrix. Indeed, 
SPE is reminiscent of the stochastic approximation approach introduced by, 
Robbins, H. & Momoe, S., "A Stochastic Approximation Method," Annals of 
Mathematical Statistics 22, 400-407 (1951), incorporated herein by reference 
in its entirety, and popularised by Rumelhart's back-propagation algorithm. 
See, Rumelhart, et aL, "Learning Representations by Back-Propagating 
Errors," Nature 323, 533-536 (1986), incorporated herein by reference in its 
entirety. 

[0040] The direction of each pairwise refinement can be thought of as an 

instantaneous gradient - a stochastic approximation of the true gradient of the 
stress ftinction. For sufficiently small numbers of X, the average direction of 
these refinements approximates the direction of steepest descent. Unlike 
classical gradient minimization schemes, the use of stochastic gradients 
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changes the effective error function in each step, and the method becomes less 
susceptible to local minima. In addition, the method exploits the redundancy 
in the inter-point distances through probability sampling. It is well known that 
the relative configuration of N points in a Z)-dimensional space can be fully 
described using only (N-D/l-l) I (D+1) distances, which is consistent with the 
linear complexity of SPE. Linear scaling in both time and memory is critical in 
modem data mining where large data sets abound. 

[0041] As with ISOMAP and LLE, SPE depends on the choice of the 

neighbourhood radius r^. If Vc is too large, the local neighbourhoods will 
include data points from other branches of the manifold, short-cutting them, 
and leading to substantial errors in the final embedding. If it is too small, it 
will lead to discontinuities, causing the manifold to fragment into a large 
number of disconnected clusters. An optimum threshold can be determined by 
examining the stability of the algorithm over a range of neighbourhood radii, 
as prescribed by Tenenbaum, J., B., "The ISOMAP Algorithm and 
Topological Stability," Science 295, 7a (2002), incorporated herein by 
reference in its entirety. 

[0042] By setting to infinity, SPE can produce nonlinear maps that are 

essentially identical to those derived by classical MDS. In this case, the 
efficiency of the algorithm is even more impressive, since virtually all of the 
randomly chosen pairs result in 'productive" work. In isometric SPE, once the 
general structure of the map has been established, the majority of pairwise 
comparisons do not result in any refinement, since most of the remote points 
are already separated beyond their lower bounds. This situation can be 
improved by caching and resampling neighbours during the course of the 
refinement. 

[0043] SPE can be applied to substantially any problem where non-linearity 

complicates the use of conventional methods such as PCA and MDS, and 
where a sensible proximity measure, like the ones mentioned above, can be 
defined. The method is computationally inexpensive to implement, and can be 
used as a tool for exploratory data analysis and visualization. The coordinates 
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produced by SPE can further be used as input to a parametric learner in order 
to derive an explicit mapping function between the observation and embedded 
spaces. 

[0044] Because SPE fundamentally seeks an embedding that is consistent with 

a set of upper and lower distance boxmds (the proximity of neighbouring 
points can be viewed as a degenerate distance range with identical lower and 
upper bounds), SPE can also be applied to other classes of distance geometry 
probl©tns including conformational analysis, (See SpeUmeyer, et al.^ 
"Conformational Analysis Using Distance Geometry Methods," Joumal of 
Molecular Graphics and Modelhng 15, 18-36 (1997), incorporated herein by 
reference in its entirety), NMR structure determination, and protein structure 
prediction (See, Havel, T. F., and Kurt, W., "An Evaluation of the Combined 
Use of Nuclear Magnetic Resonance and Distance Geometry for the 
Detemiination of Protein Conformations in Solution," Joumal of Molecular 
Biology 182, 281-294 (1985) , incorporated herein by reference in its entirety). 

[0045] FIG, 4 is a process flowchart of an example method 400 for 

implementing the SPE algorithm. The process begins at step 402, which 
includes initializing the n dimensional coordinates of the N points, 
{yuc^i = l,2,„.,iV',A: = 1,2,...,«} . 

[0046] Step 404 includes selecting a cutofiF distance Tc. 

[0047] Step 406 includes selecting a learning rate X>0. 

[0048] Step 408 includes selecting a subset of points (e.g., two points, i and/). 

The subset of points can be selected randomly. 

[0049] Step 410 includes retrieving or evaluating the proximity of the selected 

subset of points in the input space, r^, and computing their Euclidean distance 

on the n dimensional map, dy = - j;^ || . 

[0050] Iti step 412, a determination is made. If r,y <x Tc or if r^^ > Vc and dij < r^, 

processing proceeds to step 414, which includes updating or revising the 
coordinates y^c and yjk by: 
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yik <r- ytk +^ o "Zrf^* 

L Clfj + S 

V 

where s is a small number used to avoid division by zero. 
[0051] Processing then proceeds to an iteration decision in step 416, which is 

described below. 

[0052] Referring back to step 412, when ry > Vc and dij ^ r^, the coordinates 

remain unchanged, and processing proceeds to step 416. 

[0053] Steps 408 through 414 are repeated a desired mmiber of times. Thus, in 

step 416, a determination is made as to whether steps 408 through 414 have 
been performed the desired number of times. 

[0054] When steps 408 through 414 have been performed the desired number 

of times, processing proceeds to step 418, which includes decreasing the 
learning rate X by a prescribed b%. Processing then returns to step 408. Steps 
408. through 414 are performed for another desired number of times at the 
reduced learning rate X. This iterative process can be performed any number 
of times. The performance of steps 410 through 418, for different learning 
rates X can be performed for a same number of iterations or for different 
numbers of iterations. After the desired number of cycles at different learning 
rates X^ the process is terminated in step 420. 

[0055] In a study, embeddings were carried out using 100 refinement cycles, a 

linearly decreasing learning rate firom 2.0 to 0.01, and a neighbourhood radius 
at the 10% threshold of all pairwise proximities in the sample, as determined 
by probability sampling. An initial learning rate X> I was used to induce 
faster unfolding of the random initial configurations. Altemative learning 
schedules may also be employed. 
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[0056] The data points for the Swiss roll were obtained by generating 

coordinate triplets {x = 90039,3; = cpsin9,z}, where 9 and z were random 
numbers in the intervals [5, 13] and [0,10], respectively. 

[0057] The conformations of methylpropylether were generated using a 

distance geometry algorithm, which uses covalent constraints to establish a set 
of upper and lower interatoitnic distance boimds, and then attempts to generate 
conformations that are consistent with these bounds- See, Crippen, G. M., and 
Havel, T. F., *T)istance Geometry and Molecular Conformation," Research 
Studies Press, Somerset, UK, (1988), incorporated herein by reference in its 
entirety. 

[0058] The proximity between conformations was measured by RMSD (for 

two conformations, the RMSD is defined as the minimum Euclidean distance 
between the vectors of atomic coordinates when the two conformations are 
superimposed through translations and rotations). RMSD is positive, 
symmetric, and satisfies the triangular inequality, and is therefore a valid 
proximity measure for SPE. 

[0059] The 3-component virtual combinatorial Ubrary was generated by 

systematically attaching two aldehyde building blocks to a diamine core 
accordiag to the reductive amination reaction. Each product was characterised 
by 117 computed topological indices, which were subsequently normalized ui 
the interval [0, 1] and decorrelated by principal component analysis to 26 
orthogonal variables that accounted for 99% of the total variance in the data. 

[0060] The EucUdean distance in the resulting 26-dimensional PC space was 

used as a proximity measure between two compounds. The PCA pre- 
processing step was used to eliminate strong linear correlations that are typical 
of graph-theoretic descriptors and thus accelerate proximity calculations. For 
the large data sets, the reported stress values were calculated by random 
sampling of 1,000,000 pairwise distances. These stochastic stress values have 
been shown to accurately approximate the true stress. 

[0061] The presOTt iavention can be implemented in one or more computer 

systems capable of carrying out the functionality described herein. For 
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example, and without limitation, the process flowchart 400, or portions 
thereof, can be implemented in a computer system. 

[0062] FIG. 5 illustrates an example computer system 500. Various software 

embodiments are described in terms of this example computer system 500. 
After readiag this description, it will be apparent to a person skilled in the 
relevant art(s) how to implement the invention using other computer systems 
and/or computer architectures. 

[0063] The example computer system 500 includes one or more processors 

504. Processor 504 is coimected to a commimication infrastructure 502. 

[0064] Computer system 500 also includes a main memory 508, preferably 

random access memory (RAM). 

[0065] Computer system 500 can also include a secondary memory 510, 

which can include, for example, a hard disk drive 512 and/or a removable 
storage drive 514, which can be a floppy disk drive, a magnetic tsqpe drive, an 
optical disk drive, etc. Removable storage drive 514 reads from and/or writes 
to a removable storage unit 518 in a well known manner. Removable storage 
unit 518, represents a floppy disk, magnetic tape, optical disk, etc. which is 
read by and written to by removable storage drive 514. Removable storage 
unit 518 includes a computer usable storage medium having stored therein 
computer software and/or data. 

[0066] In alternative embodiments, secondary memory 510 can include other 

devices that allow computer programs or other instructions to be loaded into 
computer system 500. Such devices can include, for example, a removable 
storage unit 522 and an interface 520. Examples of such can include a program 
cartridge and cartridge interface (such as that found in video game devices), a 
removable memory chip (such as an EPROM, or PROM) and associated 
socket, and other removable storage xmits 522 and interfaces 520 that allow 
software and data to be transferred fix>m the removable storage imit 522 to 
computer system 500. 

[0067] Computer system 500 can also include a communications interface 

524, which allows software and data to be transferred between computer 
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system 500 and external devices. Examples of commumcations interface 524 
include, but are not limited to a modem, a network interface (such as an 
Ethemet card), a communications port, a PCMCIA slot and card, etc. 
Software and data transferred via communications interface 524 are in the 
form of signals 528, which can be electronic, electromagnetic, optical or other 
signals capable of being received by commxmications interface 524. These 
signals 528 are provided to coimnunications interface 524 via a signal path 
526. Signal path 526 carries signals 528 and can be implemented using wire 
or cable, fiber optics, a phone line, a cellular phone link, an RF link and other 
communications channels. 

[0068] In this document, the terms "computer program medium" and 

"computer usable medium" are used to generally refer to media such as 
removable storage xmit 518, a hard disk installed in hard disk drive 512, and 
signals 528. These computer program products are means for providing 
software to computer system 500. 

[0069] Computer programs (also called computer control logic) are stored in 

main memory 508 and/or secondary memory 510. Computer programs can 
also be received via communications interface 524. Such computer programs, 
when executed, enable the computer system 500 to perform the features of the 
present invention as discussed herein. In particular, the computer programs, 
when executed, enable the processor(s) 504 to perform the features of the 
present invention. Accordingly, such computer programs represent controllers 
of the computer system 500. 

[0070] In an anbodiment where the invention is implemented using software, 

the software can be stored in a computer program product and loaded into 
computer system 500 using removable storage drive 514, hard disk drive 512 
or communications interface 524. The control logic (software), when executed 
by the processor(s) 504, causes the processor(s) 504 to perform the fimctions 
of the invention as described herein. 

[0071] In another embodiment, the invention is implemented primarily in 

hardware using, for example, hardware components such as appUcation 



wo 03/107120 



PCTAJS03/18218 



-16- 

specific integrated circuits (ASICs). Implenientation of the hardware state 
machine so as to perform the functions described herein will be apparent to 
persons skilled in the relevant art(s). 
[0072] In yet another embodiment, the invention is implemented using a 

combination of both hardware and software. 

Conclusion 

[0073] The present invention has been described above with tihe aid of 

functional building blocks illustrating the performance of specified functions 
and relationships thereof The boundaries of these fimctional building blocks 
have been arbitrarily defined herein for tihie convenience of the description. 
Alternate boundaries can be defined so long as the specified functions and 
relationships thereof are appropriately performed. Any such alternate 
boundaries are thus within the scope and spirit of the claimed invention. One 
skilled in the art will recognize that these functional building blocks can be 
implemented by discrete components, application specific integrated circuits, 
processors executing appropriate software and the like and combinations 
thereof. 

[0074] While various embodiments of the present invention have been 

described above, it should be understood that they have been presented by way 
of example only, and not limitation. Thus, the breadth and scope of the 
presCTit invention should not be limited by any of the above-described 
exemplary embodiments, but should be defined only in accordance with the 
following claims and tiieir equivalents. 



